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INTRABODY COMMUNICATION FOR A HEARING AID 

CROSS-REFERENCE TO RELATED APPLICATIONS 

5 The present application is related to U.S. Patent Application Number 

08/666,757 filed 19 June 1996, U. S. Patent Application Number 09/193,058 filed 
16 November 1998, and the U.S. Patent Application entitled "Interference 
Suppression Techniques" and filed on even date herewith, all of which are hereby 
incorporated by reference. 

10 

BACKGROUND OF THE INVENTION 
The present invention relates to acoustic signal processing, and more 
particularly, but not exclusively, relates to communication between components of 
a hearing aid. 

15 The difficulty of extracting a desired sound in the presence of interfering 

sound sources is a long-standing problem. Especially troublesome is the 
separation of desired sound from unwanted sound with hearing aids. Generally, 
such devices do not permit selective amplification of a desired sound when 
contaminated by noise from a nearby source — particularly when the noise is more 

20 intense. This problem is even more severe when the desired sound emanates from 
a selected speaker and the nearby noise is produced by several talkers. 

One technique to address such problems is a hearing aid system that 
includes two or more components worn by a user in different locations. During 
operation, it is generally desirable that one or more communication links be 

25 established between these components using wireless interconnect technology. 

Interconnecting these components by wires or cables to facilitate communication 
is generally undesirable. Furthermore, communication through the transmission 
of electromagnetic signals through the air also has certain drawbacks, such as the 
potential for interference by stray signals and the difficulty of incorporating the 

30 necessary transmission and reception circuits into a device of a size that can be 
comfortably worn by the user. 
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Thus, there continues to be a demand for further contributions in this area 
of technology. 
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SUMMARY OF THE INVENTION 

One form of the present invention includes a unique hearing aid system. 
Other forms include unique devices and methods for processing and 
5 communicating signals for a hearing aid. Further forms, embodiments, objects, 
features, aspects, benefits, and advantages of the present invention shall become 
apparent from the detailed drawings and descriptions provided herein. 



\ 
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BRIEF DESCRIPTION OF THE DRAWINGS 

In the following figures, like reference numerals represent like features. In 
some cases, the figures or selected features thereof are not drawn to scale to 
5 enhance clarity. 

FIG. 1 is a diagrammatic view of a hearing aid system as worn by a user. 
FIG. 2 is a diagrammatic view of the system of FIG. 1 showing further 
details of selected system components. 

FIG. 3 is a diagrammatic view of another hearing aid system. 
10 FIGs. 4 and 5 illustrate yet another hearing aid system including a cochlear 

implant. 

FIG. 6 is a diagrammatic view of a signal processing arrangement for the 
system of FIG. 1. 

FIG. 7 is a flow chart of a routine executed with the arrangement of FIG. 6. 
15 FIG. 8 is a signal flow diagram of another signal processing arrangement 

for the system of FIG. 1 . 

FIG. 9 is a partial, signal flow diagram illustrating selected aspects of dual 
delay lines of FIG. 8 in greater detail. 

FIG. 10 is a diagram illustrating selected geometric features of the system 
20 of FIG. 1 for a representative example of one of a number of acoustic signal 
sources. 

FIG. 11 is a diagram illustrating selected aspects of the localization 
operator of FIG. 8 in greater detail. 

FIG. 12 is a diagram illustrating yet another signal processing arrangement 
25 for the system of FIG. 1 . 

FIG. 13 is a signal flow diagram illustrating selected aspects of the 
locali2ation operator of FIG. 12 in greater detail. 

FIG. 14 is a graph illustrating a plot of coincidence loci for two sound 
sources. 

30 FIG. 15 is a graph illustrating coincidence patterns for azimuth positions 

corresponding to -75 degrees, 0 degrees, 20 degrees, and 75 degrees. 
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DESCRIPTION OF SELECTED EMBODIMENTS 
While the present invention may be embodied in many different fonns, for 
the purpose of promoting an understanding of the principles of the invention, 
reference will now be made to the embodiments illustrated in the drawings and 
5 specific language will be used to describe the same. It will nevertheless be 
understood that no limitation of the scope of the invention is thereby intended. 
Any alterations and further modifications in the described embodiments, and any 
further applications of the principles of the invention as described herein are 
contemplated as would normally occur to one skilled in the art to which the 
10 invention relates. 

FIG. 1 illustrates hearing aid system 20 of one embodiment of the present 



invention worn by hearing aid user 21.[Asused herein, "heari ng aid " or "hearing 
^aftlys^ to My^paratuTused to enhance normalhemng or 

^i^aired heanngof M individual^System 20 includes two acoustic input/output 
15 (I/O) components 30a and 30b, and processing component 30c (collectively 

designated modules 30). Modules 30 are each at least partially in contact with skin 
26 of user 21 and are spaced apart from one another. 

Acoustic I/O components 30a, 30b are each disposed in a corresponding 
passage of the ears El, E2 of user 21, and include acoustic sensors 22a, 22b 
20 opposing earphones 24a, 24b, respectively. Acoustic sensors 22a and 22b 

collectively form acoustic sensing array 22. In one embodiment, acoustic sensors 
22a, 22b are omnidirectional dynamic microphones. In other embodiments, a 
different type of microphone or sensor type can be utilized as would occur to one 
skilled in the art. Acoustic I/O components 30a, 30b also each include a pair of 
25 signal conductors 33 that are alternatively designated electrode pairs 33a, 33b, 
respectively (shown in phantom). 

Processing component 30c also includes a pair of conductors 33 
alternatively designated electrode pair 33c (also shown in phantom). Processing 
component 30c is worn outside ears El, E2 on the wrist of user 21, and resembles 
30 a common wrist watch device. 

Referring additionally to FIG. 2, further details regarding modules 30 of 
system 20 are illustrated. Each of modules 30 includes circuit housing 31. Circuit 
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housing 31 has an outer layer 32 that at least partially covers conductors 33 of the 
corresponding electrode pair 33a, 33b, 33c. Layer 32 is typically in the form of a 
dielectric material suitable for long-term contact with skin 26 of user 21. In FIG. 
2, components 30a, 30b, 30c are more specifically shown in contact with 

5 respective skin regions 26a, 26b, 26c. 

Each acoustic signal input/output component 30a, 30b includes input (I/P) 
circuitry 34 coupled to a respective acoustic sensor 22a, 22b and output (O/P) 
circuitry 35 coupled to a respective earphone 24a, 24b. The input circuitry 34 is 
further coupled to a corresponding transmitter circuit (TTXR) 36. For each acoustic 

10 I/O component 30a, 30b, input circuitry 34 conditions signals received from the 
respective acoustic sensor 22a, 22b for transmission by the transmitter 36 coupled 
thereto. In one embodiment, input circuitry 34 includes filtering, amplification, 
and an analog-to-digital (A/D) converter to provide a signal to transmitter 36 in a 
desired digital format For this embodiment, transmitter 36 can be arranged to 

15 modulate digital input from input circuitry 34 using pulse code modulation (PCM), 
pulse amplitude modulation (PAM) such as a frequency-shift-keying (FSK) 
technique, or a different digital communication scheme as would occur to those 
skilled in the arL 

In another embodiment, input circuitry 34 is configured to transmit an 
20 analog signal representative of acoustic excitation detected by the respective 

acoustic sensor 22a or 22b. For this embodiment, transmitter 36 can be configured 
to transmit signals in a frequency mpdulated (FM) form or other analog 
communication format as would occur to those skilled in the art. In still other 
embodiments, input circuitry 34 and/or transmitter 36 can be configured in a 
25 different manner, such as two or more separate units; or as a single, integral 
transmission unit. 

Output circuitry 35 for each acoustic I/O component 30a, 30b is operatively 
coupled to a corresponding receiver circuit (RXR) 37. Output circuitry 35 receives 
communication signals from the coupled receiver 37 and is arranged to condition 
30 such signals to provide a desired output to a respective earphone 24a or 24b of the 
corresponding acoustic I/O component 30a or 30b. As described in connection 
with input circuitry 34 and transmitter 36, output circuitry 35 and receiver 37 are 
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configured to compatibly process signals based on the desired communication 
format. 

Processing component 30c also includes one or more transmitters 36 and 
receivers 37 which are operatively coupled to signal processing subsystem 44. 

5 Processing component 30c further includes a user input control 46 and auxiliary 
output 48 coupled to signal processing subsystem 44. Signal processing subsystem 
44 processes inputs received by the one or more receivers 37 of processing 
component 30c and generates corresponding output signals for transmission by the 
one or more transmitters 36 of processing component 30c. 

0 Communication between modules 30 is performed by electrical conduction 

along one or more pathways formed by skin 26. The double-headed arrows 27a, 
27b represent such communication pathways along portions of skin 26 between 
skin regions 26a, 26b f and 26c. Electrode pairs 33a, 33b, 33c provide for electrical 
coupling of components 30a, 30b, 30c to skin regions 26a, 26b, 26c, respectively. 

5 The electrical properties of human skin under nominal conditions facilitate the 
transmission of information in the form of a time varying electrical signal. 
Electrical conduction using human skin as a transmission medium can be described 
using a lumped element model at lower signal frequencies or a waveguide model at 
higher signal frequencies. To transmit an electric signal along skin 26, transmitter 

0 36 of one of modules 30 applies a suitable time varying electric potential across a . 
corresponding one of the electrode pairs 33a, 33b, 33c electrically coupled to skin 
26. The electric signal is transmitted by a closed electric circuit that links the 
communicating modules 30. This closed circuit includes electrical conduction 
pathways formed by skin 26 between the electrode pairs 33a, 33b, 33c of the 

5 communicating modules 30. 

Because of the intervening dielectric layer 32, electrode pairs 33a, 33b, 33c 
capacitively couple to the respective skin regions 26a, 26b, 26c. Layer 32 is 
composed and dimensioned relative to operating frequencies selected for 
transmitters 34 and receivers 37 to provide for suitable communication between 

0 modules 30 of system 20. In other embodiments, layer 32 may be absent, 

permitting direct contact between conductors 33 and skin 26, thereby allowing 
transmission by resistive coupling. 
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During operation of system 20, sound is detected with acoustic sensors 22a, 
22b of components 30a, 30b. The corresponding acoustic input signals are 
conditioned with input circuitry 34 and supplied to transmitter 36 for each of the 
acoustic I/O components 30a, 30b. Transmitter 36 transmits the conditioned 

5 acoustic input signals along pathways 27a, 27b through electrode pairs 33a, 33b 
coupled to skin regions 26a, 26b f respectively. Processing component 30c receives 
signals transmitted along pathways 27a, 27b with its one or more receivers 37 via 
electrical coupling of electrode pair 33c with skin region 26c. Processing 
component 30c processes received signals with signal processing subsystem 44. A 

10 few nonlimiting examples of various configurations of subsystem 44 are described 
in connection with the signal processing arrangements of FIGs. 6-15 hereinafter. 

Processing component 30c transmits corresponding acoustic output signals 
to acoustic I/O components 30a f 30b along pathways 27a, 27b with its one or more 
transmitters 36 via electrode pair 33c. Each acoustic I/O component 30a, 30b 

15 receives acoustic output signals supplied by processing component 30c with a 

corresponding receiver 37. The receivers 37 of acoustic I/O components 30a, 30b 
provide signals to the corresponding output circuitry 37 that drives a respective 
earphone 24a, 24b. 

Processing component 30c also includes user input control 46 and auxiliary 
20 output 48. Control 46 can be utilized to change user-selectable parameters for 
signal processing subsystem 44. Alternatively or additionally, control 46 can 
provide for selection between different signal processing arrangements for system 
20, such as those described in connection with FIGs. 6-15 to name just a few. 
Auxiliary output 48 can be used to perform diagnostics and maintenance for 
25 system 20 and/or to provide output signals from component 30c to a loudspeaker 
as an addition or alternative to earphones 24a, 24b. 

Modules 30 are each capable of **two way" communication given the 
ability to both transmit and receive communication signals. For each module 30, 
one electrode pair 33a, 33b, or 33c is shared by the corresponding transmitters) 36 
30 and receivers) 37. In an alternative embodiment, one or more modules can 

include multiple electrode pairs, with a different electrode pair dedicated to each 
module transmitter or receiver. Further, to distinguish between different 
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communication sources and destinations, different carrier frequencies can be used. 
Accordingly, processing component 30c could include a different transmitter and 
receiver for each acoustic I/O component 30a, 30b or multiplex between settings of 
a single transmitter and receiver. Alternatively or additionally, transmitted signals 
5 can be encoded with signal source and/or signal destination information for later 
decoding by the receiving component. 

In other alternative embodiments, communication between certain modules 
is only one-way (unidirectional). Such one-way communication may be desired 
when a hearing aid system component only includes an acoustic input device such 
10 as sensor 22a or 22b or only an acoustic output device, such as earphone 24a or 

24b. Further, different communication signal formats/modulations can be used for 
different communication pathways. In still further embodiments, one or more 
other communication techniques besides electrical conduction along the skin are 
utilized. 

15 Referring to FIG. 3, hearing aid system 20a of another embodiment of the 

present invention is illustrated. System 20a includes directional receiving wand 40 
with two opposed acoustic sensors 22c. System 20a also includes earphone device 
24c. Wand 40 and device 24c communicate via electrical conduction along one or 
more pathways formed by skin 26d of user 21a. Accordingly, device 24c and 

20 wand 40 each include a pair of electrodes (not shown) for electrically coupling 
with skin 26d. Furthermore, these devices include transmitter and/or receiver 
circuitry as necessary to implement desired communication pathways. In one 
embodiment of system 20a, wand 40 includes signal processing subsystem 44 and 
sensors 22c in a single hand-held unit. This unit has a one-way communication 

25 path with earphone device 24c. In another embodiment, a signal processing 

subsystem is partially or completely included in earphone device 24c. In still other 
embodiments, a separate module (not shown) performs processing, such as a 
device worn around the neck of user 21a, a device worn on the user's wrist as 
illustrated in FIG. 1, or such other type of device as would occur to those skilled in 

30 the art. As in the case of system 20, system 20a can include more than one 
earphone device, too. 

Referring to FIGs. 4 and 5, hearing aid system 20b of yet another 

9 
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embodiment of the present invention is illustrated. System 20b includes a pair of 
behind-the-ear acoustic sensor units 22d, 22e. More particularly, FIG. 5 shows a 
partial side view of sensor unit 22e and further illustrates conductors 33 (in 
phantom) which are also designated as electrode pair 33d. System 20b further 
5 includes cochlear implant 40a. Cochlear implant 40a is disposed in a middle ear 
passage of user 21b and is configured to provide electrical stimulation signals 
along the middle ear in a standard manner. Devices 22d and 22e communicate 
with implant 40a by electrical conduction along pathways formed by skin 26e of 
user 21b. One or more of devices 22d, 22e, 40a can include signal processing 

10 circuitry desired to provide enhanced hearing perception via cochlear implant 40a. 
In one embodiment, one of devices 22d, 22e houses such circuitry with the other 
being in one-way communication to provide a corresponding acoustic sensor input 
signal. In still other embodiments, additional components may be included to 
partially or completely contain a signal processing subsystem arranged for 

15 communication with devices 22d, 22e, 40a by electrical signal conduction along 
skin 26e. 

It should be understood that modules of systems 20, 20a, 20b include 
power supplies and other components as would occur to those skilled in the art for 
implementation. Also, in other embodiments, modules of the various systems 20, 

20 20a, 20b may be exchanged, duplicated, or deleted as would occur to those skilled 
in the art. Also, various signal processing techniques may be implemented by the 
processing components of systems 2p, 20a, 20b, a few of which are described in 
connection with FIGs. 6-15 as follows. 

Referring to FIGs. 1 and 6, one embodiment of a signal processing 

25 arrangement 1 10 for system 20 is next described, where like reference numerals 
refer to like features. Arrangement 1 10 is configured to extract a desired acoustic 
excitation from a desired source, such as source 1 12, while suppressing noise from 
other sources, such as acoustic sources 114, 116. For arrangement 110, acoustic 
sensors 22a, 22b of array 22 are oriented to detect acoustic excitation from sources 

30 1 12, 1 14, 1 16. It should be understood that this configuration of sources is merely 
one example. Accordingly, in other embodiments, more of fewer sources with 
different orientations can be present 
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Sensors 22a, 22b are separated by distance D as illustrated by the like 
labeled line segment along lateral axis T. Lateral axis T is perpendicular to 
azimuthal axis AZ. Midpoint M represents the halfway point along distance D 
between sensor 22a and sensor 22b. Axis AZ intersects midpoint M and acoustic 

5 source 1 12. Axis AZ is designated as a point of reference (zero degrees) for 
sources 112, 114, 116 in the azimuthal plane and for sensors 22a, 22b. For the 
depicted embodiment, sources 114, 116 define azimuthal angles 114a, 116a 
relative to axis AZ of about -65° and +22°, respectively. Correspondingly, acoustic 
source 112 is at 0° relative to axis AZ. In one mode of operation, the "on axis" 

0 alignment of acoustic source 112 with axis AZ selects it as a desired source of 
acoustic excitation to be monitored with arrangement 1 10. In contrast, the "off- 
axis" sources 114, 116 are treated as noise and suppressed by arrangement 110, 
which is explained in more detail hereinafter. To adjust the direction being 
monitored, sensors 22a, 22b can be moved to change the position of axis AZ. 

5 Accordingly, user 21 can move his or her head to change the relative position of 
axis AZ defined between sensors 22a, 22b for arrangement 110. In an additional 
or alternative operating mode, the designated monitoring direction can be adjusted 
by changing a direction indicator incorporated in the routine of FIG. 7 as more 
fully described below. For these operating modes, it should be understood that 

0 neither sensor 22a nor 22b needs to be moved to change the designated monitoring - 
direction, and the designated monitoring direction need not be coincident with axis 
AZ. \ 

For the convenience of description, sensors 22a, 22b are designated as 
belonging to left channel Land right channel R, respectively. Further, the analog 

5 time domain signals provided by sensors 22a, 22b are designated jc L (r) and x R (r) for 
the respective channels L and R, where t represents time. Components 30a, 30b 
condition and format input signals x L (i) and x R {t) in a manner suitable for 
transmission to processing component 30c. Either before or after transmission, 
signals xlQ) and jc*(0 undergo an analog-to-digital (A/D) conversion with 

3 appropriate sampling hardware to provide discrete signals xl(z) and xr(z), 
corresponding to channels L and R, respectively; where z indexes discrete 



11 



WO 01/87014 



PCT/US01/14945 



sampling events. The sampling rate fs is selected to provide desired fidelity for a 
frequency range of interest 

For arrangement 110, signal processing subsystem 44 is configured to 
include signal processor 42 operati vely coupled to memory 50. Memory 50 is 

5 further depicted with buffers 52, 54. Processor 42 can be a software or firmware 
programmable device, a state logic machine, or a combination of both 
programmable and dedicated hardware. Furthermore, processor 42 can be 
comprised of one or more components and can include one or more Central 
Processing Units (CPUs). In one embodiment, processor 42 is in the form of a 

0 digitally programmable, highly integrated semiconductor chip particularly suited 
for signal processing. In other embodiments, processor 42 may be of a general 
purpose type or other arrangement as would occur to those skilled in the art 
Likewise, memory 50 can be variously configured as would occur to those skilled 
in the art Memory 50 can include one or more types of solid-state electronic 

5 memory, magnetic memory, or optical memory of the volatile and/or nonvolatile 
variety. Furthermore, memory can be integral with processor 42 and/or comprised 
of one or more distinct elements. Processing subsystem 44 can also include any 
oscillators, control clocks, interfaces, signal conditioners, additional filters, 
limiters, converters, power supplies, communication ports, or other types of 

10 components as would occur to those skilled in the art to implement the present 
invention. In one embodiment, subsystem 44 is provided in the form of a single 
microelectronic device. \ 

Referring also to the flow chart of FIG. 7, routine 240 is illustrated. In 
stage 242, routine 240 begins with initiation of the A/D sampling and storage of 

15 the resulting discrete input samples x L (z) and x R (z) in buffer 52 in a First-In-First- 
Out (FIFO) sequence. Sampling is performed in parallel with other stages of 
routine 240 as will become apparent from the following description. Routine 240 
proceeds from stage 242 to conditional 244. Conditional 244 tests whether routine 
240 is to continue. If not, routine 240 halts. Otherwise, routine 240 continues with 

10 stage 246. Conditional 244 can correspond to an operator switch, control signal, or 
power control associated with system 20 (not shown). 
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In stage 246, a fast discrete fourier transform (EFT) algorithm is executed 
on a sequence of samples xi£z) and xr(z) and stored in buffer 54 for each channel L 
and R to provide corresponding frequency domain signals XlQc) and X*(fc); where 
k is an index to the discrete frequencies of the FFTs. The set of samples xl(z) and 
5 x R (z) upon which an EFT is performed can be described in terms of a time duration 
of the sample data. Typically, for a given sampling rate f s , each FFT is based on 
more than 100 samples. Furthermore, for stage 246, FFT calculations include 
application of a windowing technique to the sample data. One embodiment utilizes 
a Hamming window. In other embodiments, data windowing can be absent or a 

10 different type utilized, the FFT can be based on a different sampling approach, 

and/or a different transform can be employed as would occur to those skilled in the 
art After the transformation, the resulting spectra Xi(k) and X R (k) are stored in 
FFT buffer 54 of memory 50. These spectra are generally complex- valued. 

It has been found that reception of acoustic excitation emanating from a 

15 desired direction can be improved by weighting and summing the input signals in a 
manner arranged to minimize the variance (or equivalently, the energy) of the 
resulting output signal while under the constraint that signals from the desired 
direction are output with a predetermined gain. The following relationship (1) 
expresses this linear combination of the frequency domain input signals: 

20 Y(k) = W;(k)X x (k) = W* (k)X(k); (1) 

Y(k) is the output signal in frequency domain form, Wi(k) and Wr(K) are complex 
valued multipliers (weights) for each frequency k corresponding to channels L and 

25 R, the superscript denotes the complex conjugate operation, and the superscript 
"H" denotes taking the Hermitian of a vector. For this approach, it is desired to 
determine an "optimal" set of weights W L (k) and W R (k) to minimize variance of 
Y(k). Minimizing the variance generally causes cancellation of sources not aligned 
with the desired direction. For the mode of operation where the desired direction is 

30 along axis AZ, frequency components which do not originate from directly ahead 

13 
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of the array are attenuated because they are not consistent in phase across the left 
and right channels L, R, and therefore have a larger variance than a source directly 
ahead. Minimizing the variance in this case is equivalent to minimizing the output 
power of off-axis sources, as related by the optimization goal of relationship (2) 
5 that follows: 

MmE{\Y{kf} (2) 

where Y(k) is the output signal described in connection with relationship (1). In 
one form, the constraint requires that "on axis" acoustic signals from sources along 
10 the axis AZ be passed with unity gain as provided in relationship (3) that follows: 

e"W(*) = l (3) 

Here e is a two element vector which corresponds to the desired direction. When 
this direction is coincident with axis AZ, sensors 22a and 22b generally receive the 

15 signal at the same time and amplitude, and thus, for source 1 12 of the illustrated 
embodiment, the vector e is real- valued with equal weighted elements - for 
instance e H =[ 0.5 0.5 ]. In contrast, if the selected acoustic source is not on axis 
AZ, then sensors 22a, 22b can be moved to align axis AZ with it. 

In an additional or alternative mode of operation, the elements of vector e 

20 can be selected to monitor along a desired direction that is not coincident with axis 
AZ. For such operating modes, vector e becomes complex-valued to represent the 
appropriate time/phase delays between sensors 22a, 22b that correspond to acoustic 
excitation off axis AZ. Thus, vector e operates as the direction indicator 
previously described. Gorrespondingly, alternative embodiments can be arranged 

25 to select a desired acoustic excitation source by establishing a different geometric 
relationship relative to axis AZ. For instance, the direction for monitoring a 
desired source can be disposed at a nonzero azimuthal angle relative to axis AZ. 
Indeed, by changing vector e, the monitoring direction can be steered from one 
location to another without moving either sensor 22a, 22b. 

30 For inputs XiXk) and X*(k) that are indicative of stationary random 

processes (which is typical of speech signals over small periods of time), the 

14 
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following weight vector W(k) relationship (4) can be determined from 
relationships (2) and (3): 



W(M = R ^ le (4) 



where e is the vector associated with the desired reception direction, R(k) is the 
correlation matrix for the Jfc* frequency, W(k) is the optimal weight vector for the 
Jfc* frequency and the superscript M" denotes the matrix inverse. The derivation 
of this relationship is explained in connection with a general model of the present 
invention applicable to embodiments with more than two sensors 22a, 22b in array 
22. 

The correlation matrix R(fc) can be estimated from spectral data obtained 
via a number "M" of fast discrete Fourier transforms (FFTs) calculated over a 
relevant time interval. For the two channel L, R embodiment, the correlation 
matrix for the frequency, R(fc), is expressed by the following relationship (5): 



R(*) = 



1 H M N 

i£x/(n,*)X,(>U) ^£* r (n,k)X,(n 9 k) 



[*„(*) x n (k)\ 



(5) 



where Xi is the FFT in the frequency buffer for the left channel L and X r is the FFT 
in the frequency buffer for right channel R obtained from previously stored FFTs 
that were calculated from an earlier execution of stage 246; "n" is an index to the 
number "AT of FFTs used for the calculation; and "M" is a regularization 
parameter. The terms X ti (k\ XUk) 9 X r /(Jt), and XrJk) represent the weighted sums 
for purposes of compact expression. It should be appreciated that the elements of 
the R(Jfc) matrix are nonlinear, and therefore Y{k) is a nonlinear function of the 
inputs. 

Accordingly, in stage 248 spectra Xi(k) andX^fc) previously stored in buffer 
54 are read from memory 50 in a First-In-First-Out (FIFO) sequence. Routine 240 
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then proceeds to stage 250. In stage 250, multiplier weights Wl(*), W R (jfc) are 
applied to Xi(k) and X^k), respectively, in accordance with the relationship (1) for 
each frequency k to provide the output spectra Y(k). Routine 240 continues with 
stage 252 which performs an Inverse Fast Fourier Transform (IFFT) to change the 
5 Y(k) EFT determined in stage 250 into a discrete time domain form designated y(z). 
It should be understood that correspondence between Y(k) FFTs and output sample 
y(z) can vary. In one embodiment, there is one Y(k) FFT output for every y(z), 
providing a one-to-one correspondence. In another embodiment, there may be one 
Y(k) FFT for every 16 output samples y(z) desired, in which case the extra samples 
10 can be obtained from available Y(k) FFTs. In still other embodiments, a different 
correspondence may be established 

Next, in stage 254, digital-to-analog (D/A) conversion is performed with 
appropriate hardware to provide a corresponding analog output signal y(t). After 
conversion to the continuous time domain form, signal y(f) is transmitted from 
15 subsystem 44 of processing component 30c to acoustic I/O components 30a, 30b. 
Output circuitry 37 conditions the received signals and drives earphones 24a, 24b. 
Arrangement 110 can be used to deliver generally the same sound to each ear of a 
user. Alternatively arrangement 110 can include further processing of output 
signals derived from y(t) to provide sound to each ear that selectively differs in 
20 terms of intensity and/or timing to account for differences in the orientation of the 
desired sound source relative to acoustic sensors 22a, 22b to improve sound 
perception. \ 

After stage 254, routine 240 continues with conditional 256. In many 
applications it may not be desirable to recalculate the elements of weigfit vector 
25 W(fc) for every Y(k). Accordingly, conditional 256 tests whether a desired time 

interval has passed since the last calculation of vector W(fc). If this time period has 
not lapsed, then control flows to stage 258 to shift buffers 52, 54 to process the 
next group of signals. From stage 258, processing loop 260 closes, returning to 
conditional 244. Provided conditional 244 remains true, stage 246 is repeated for 
30 the next group of samples of x L (z) and x R (z) to determine the next pair of X L (k) and 
Xs(k) FFTs for storage in buffer 54. Also, with each execution of processing loop 
260, stages 248, 250, 252, 254 are repeated to process previously stored X t (k) and 
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XjQc) EFTs to determine the next Y(k) EFT and correspondingly generate a 
continuous y(t). In this manner buffers 52, 54 are periodically shifted in stage 258 
with each repetition of loop 260 until either process 240 halts as tested by 
conditional 244 or the time period of conditional 256 has lapsed 
5 If the test of conditional 256 is true, then routine 240 proceeds from the 

affirmative branch of conditional 256 to calculate the correlation matrix R(fc) in 
accordance with relationship (5) in stage 262. From this new correlation matrix 
R(fc), an updated vector W(fc) is determined in accordance with relationship (4) in 
stage 264. From stage 264, update loop 270 continues with stage 258 previously 
10 described, and processing loop 260 is re-entered until routine 240 halts per 
conditional 244 or the time for another recalculation of vector W(k) arrives. 
Notably, the time period tested in conditional 256 may be measured in terms of the 
number of times loop 260 is repeated, the number of FFTs or samples generated 
between updates, and the like. Alternatively, the period between updates can be 
dynamically adjusted based on feedback from an operator or monitoring device 
(not shown). 

Processing subsystem 44 performs the tests of conditionals 244 and 256, 
and executes the operations associated with stages 246, 248, 250, 252, 258, 262, 
and 264 of routine 240. In one embodiment, signal processor 42 is of a 
programmable type with software configured to execute these stages and 
conditionals. In other embodiments, some or all of these operations may be 
performed with dedicated hardware of subsystem 44. The AID and D/A 
conversion operations of stages 242 and 254, respectively, can be performed by 
subsystem 44 or by acoustic I/O components 30a, 30c as appropriate for the 
particular type of communication signal format desired. 

When routine 240 initially starts, earlier stored data is not generally 
available. Accordingly, appropriate seed values may be stored in buffers 52, 54 in 
support of initial processing. In other embodiments, a greater number of acoustic 
sensors can be included in array 22 and routine 240 can be adjusted accordingly. 
For this more general form, the output can be expressed by relationship (6) as 
follows: 

y(*) = W H (*)X(Jfc) (6) 
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10 



where the X(fc) is a vector with an entry for each of "C" number of input channels 
and the weight vector W(Jk) is of like dimension. Equation (6) is the same at 
equation (1) but the dimension of each vector is C. instead of 2. The output power 
can be expressed by relationship (7) as follows: 

E[Y(Jfc) 2 J= BmkfX(.k)X H {k)Wm = W(fe) H R(fc) W(*) (7) 

where the correlation matrix R(Jk) is square with "C x C dimensions. The vector e 
is the steering vector describing the weights and delays associated with a desired 
monitoring direction and is of the form provided by relationship (8).that follows: 

^=4-^ ,**M"«r (8) 



where C is the number of array elements and ^ is the desired monitoring direction 
expressed by relationship (9) as: 

^(Jfc)=(27cDjtfs/(CN)) for i=0,l, ...,N-1 (9) 

Thus, vector e may be varied with frequency to change the desired monitoring 
15 direction or "look-direction" and correspondingly steer the array. With the same 
constraint regarding vector e as described by relationship (3), the problem can be 
summarized by relationships (10) as follows: 

Minimize{ W(*) H R(*) W(*) } 

w<*> (10) 

such that e H W(fc)=l \ 

This problem can be solved using the method of Lagrange multipliers generally 
20 characterized by relationship (1 1) as follows: 

Minimize { CostFunction + X*Constraint} C 1 

W(t) 

25 where the cost function is the output power, and the constraint is as listed above for 
vector e. A general vector solution begins with the Lagrange multiplier function 

H(W) of relationship (12): 

H(W) =Iw(ik) H R(*)W(fc)+A(e H W(*)-l) ( 12 ) 
2 

18 



WO 01/87014 



PCT/US01/14945 



where the factor of one half (V4) is introduced to simplify later math. Taking the 
gradient of H(W) with respect to W(k), and setting this result equal to zero, 
relationship (13) results as follows: 

V W H(W) = R(*)W(*)+eA = 0 (13) 

5 Also, relationship (14) follows: 

W(Jt) = -R(Jt)' 1 eA (14) 

Using this result in the constraint equation relationships (15) and (16) result as 

follows: 

e H [-R(*r l el]=l (15) 
10 A = -[e H R(^r 1 ef 1 (16) 

and using relationship (114), the optimal weights are as set forth in relationship 
(17): 

W^^riWet 1 (17) 

15 Because the bracketed term is a scalar, relationship (4) has this term in the 
denominator, and thus is equivalent. v 

Returning to the two variable case for the sake of clarity, relationship (5) 
may be expressed more compactly by absorbing the weighted sums into the terms 
Xui Xin Xri and X rr , and then renaming them as components of the correlation 

20 matrix R(fc) per relationship (1 8): 

Its inverse may be expressed in relationship (19) as: 
R(*) -1 = 



" *n / (19) 

-R 2l R n J det(R(*)) 
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where detO is the determinant operator. If the desired monitoring direction is 
perpendicular to the sensor array, e = [0.5 0.5] T , the numerator of relationship (4) 
may then be expressed by relationship (20) as: 



Using the previous result, the denominator is expressed by relationship (21) as: 
.»K(«-..=[0, 0,].^].^= 

(R u +^-^-^i)% et(R(fc)) 

Canceling out the common factor of the determinant, the simplified relationship 
(22) is completed as: 

10 M = (22) 

It can also be expressed in terms of averages of the sums of correlations between 
the two channels in relationship (23) as: 

"",(*)]__ i ,|X (*)-*„(*)] (23) 

_w,(k)\ (x B (*)+x„(*)-^(fc)-x rf (*)) WV-XAV] 



15 where w^c) and w,(fc) are the desired weights for the left and right channels, 

respectively, for the ** frequency, and the components of the correlation matrix are 
now expressed by relationships (24) as: 



N «=» (24) 

XrrW = ¥rf,X r \n,k)X r (n,V 
*V 11=1 

20 



WO 01/87014 



PCT/US01/14945 



just as in relationship (5). Thus, after computing the averaged sums (which may be 
kept as running averages), computational load can be reduced for this two channel 
embodiment. 

Referring to FIGs. 1 and 8-11, signal processing arrangement 310 for system 20 is 
5 described, where like reference numerals refer to like features. The signal flow diagram 
of FIG. 8 corresponds to various stages of arrangement 310. Left and right "R" input 
channels correspond to acoustic sensors 22a, 22b, which provide input sigrals x^t), 
*Rn(th respectively. Input signals xmft) and XRn(t) correspond to analog composites of 
sounds from multiple acoustic sources located within the detection range of sensors 22a, 

10 22b; where V is the familiar continuous time domain variable. Signals xuKt) and xjUt) 
are converted to digital form before or after transmission from acoustic I/O components 
30a, 30b to provide discrete signals xm(k) andx^Jk), respectively; where "fc" is the 
discrete sample index variable. 

For arrangement 310, subsystem 44 of system 20 is configured with appropriate 

15 processing hardware and/or software to include Digital Fourier Transform (DFT) stages 
336a, 336b; delay operator 340; signal operator 350; localization operation 360; 
extraction stage 380, Inverse Fourier Transform 382; and post extraction processing 480. 
DFT stages 336a, 336b transform input signals xijk) and XRn(k) into spectral signals 
designated XuAm) and X^m), respectively, using a short term discrete Fourier transform 

20 algorithm. Spectral signals Xm(m) and XR n (m) are expressed in terms of a number of 
discrete frequency components indexed by integer m\ where m=l, 2, . .., M. Also, as 
used herein, the subscripts L and R denote the left and right channels, respectively, and n 
indexes time frames for the discrete Fourier transform analysis. 

Delay operator 340 receives spectral signals Xufm) and XR n (m) from stages 336a, 

25 336b, respectively. Delay operator 340 includes a number of dual delay lines (DDLs) 
342 each corresponding to a different one of the component frequencies indexed by m. 
Thus, there are M different dual delay lines 342. However, only dual delay lines 342 
corresponding to m=l and m=M are shown in FIG. 8 to preserve clarity. The remaining 
dual delay lines corresponding to m=2 through m=(M-l) are represented by an ellipsis. 

30 The pair of frequency components from DFT stages 336a, 336b corresponding to a 

given value of m are inputs into a corresponding one of dual delay lines 342. For the 
examples illustrated in FIG. 8, spectral signal component pair 'Xuj[m=l) and XR n (m=l) 
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is sent to the upper dual delay line 342 for the frequency corresponding to m=l; and 
spectral signal component pair Xu(m-M) and X Rj1 (m=M) is sent to the lower dual delay 
line 342 for the frequency corresponding to m=M . Likewise, common frequency 
component pairs of Xtnim) and X^m) for frequencies corresponding to m=2 through 
5 m=(M-l) are each sent to a corresponding dual delay line as represented by ellipses to 
preserve clarity. 

Referring additionally to Fig. 9, certain features of dual delay line 342 are further 
illustrated. Each dual delay line 342 includes a left channel delay line 342a receiving a 
corresponding frequency component input from DFT stage 336a and right channel delay 

10 line 342b receiving a corresponding frequency component input from DFT stage 336b. 
Delay lines 342a, 342b each include an odd number I of delay stages 344 indexed by 
1=1,2,..., L The I number of delayed signal pairs are provided on outputs 345 of delay 
stages 344 and are correspondingly sent to complex multipliers 346. There is one 
multiplier 346 corresponding to each delay stage 344 for each delay line 342a, 342b. 

15 Multipliers 346 provide equalization weighting for the corresponding outputs of delay 
stages 344. Each delayed signal pair from corresponding outputs 345 has one member 
from a delay stage 344 of left delay line 342a and the other member from a delay stage 
344 of right delay line 342b. Complex multipliers 346 of each dual delay line 342 output 
corresponding products of the I number of delayed signal pairs along taps 347. The I 

20 number of signal pairs from taps 347 for each dual delay line 342 of operator 340 are 
input to signal operator 350. 

For each dual delay line 34?, the I number of pairs of multiplier taps 347 are each 
input to a different Operation Array v (OA) 352 of operator 350. Each pair of taps 347 is 
provided to a different operation stage 354 within a corresponding operation array 352. 

25 In FIG, 9, only a portion of delay stages 344, multipliers 346, and operation stages 354 
are shown corresponding to the two stages at either end of delay lines 342a, 342b and the 
middle stages of delay lines 342a, 342b. The intervening stages follow the pattern of the 
illustrated stages and are represented by ellipses to preserve clarity. 

For an arbitrary frequency oo m , delay times x,- are given by equation (25) as follows: 

30 

*i =— ^sin(— *-^), ...,/ (25) 
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where, i is the integer delay stage index in the range (i=l, ..... T)\ TTDtw = D/c is the 
maximum Intermicrophone Time Difference; D is the distance between sensors 22a, 22b; ^ 
and c is the speed of sound. Further, delay times x§ are antisymmetric with respect to the 
midpoint of the delay stages corresponding to i=(/+l)/2 as indicated in the following 
equation (26): 



10 As described in connection with arrangement 1 10 of FIG. 6, an azimuthal plane 
can be defined in relation to acoustic sensors 22a and 22b spaced apart by distance 
D. For arrangement 310, this azimuthal plane is uniformly divided into I sectors 
with the azimuth position of each resulting sector being given by equation (27) as 
follows: 



15 



ft =i^!l80° -90". i=L .... /• (27) 

1 /-l 



The azimuth positions in auditory space may be mapped to corresponding delayed 
signal pairs along each dual delay line 342 in accordance with equation (28) as 
20 follows: 



Tj = — - — suxef|. (28) 



Multipliers 346 have been included to multiply each corresponding delay stage 344 
25 by an appropriate one of equalization factors a, (m)\ where i is the delay stage 

index previously described. Preferably, elements at (m) are selected to compensate 
for differences in the noise intensity at sensors 22a, 22b as a function of both 
azimuth and frequency. In alternative embodiments where these differences can be 
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neglected or are not present, a«- f m> may be set to unity, making multipliers 346 
unnecessary. 

One preferred embodiment for determining equalization factors a, (m) 
assumes amplitude compensation is independent of frequency, regarding any 
5 departure from this model as being negligible. For this embodiment, the amplitude 
of the received sound pressure | p | varies with the source-receiver distance r in 
accordance with equations (Al) and (A2) as follows: 

lpl~-, (Al) 



10 



r 



T~ = -S (A2) 



where | pi | and | p* | are the amplitude of sound pressures at sensors 22a, 22b. 
FIG. 10 depicts sensors 22a, 22b and a representative acoustic source SI within the 
15 range of reception to provide input signals XLn( t) and x&j[t). According to the 

geometry illustrated in FIG. 10, the distances r^and r& from the source SI to the 
left and right sensors, respectively, are given by equations (A3) and (A4), as 
follows: 



20 



r L m Vasinfi} + D/2) 2 +(/cos0 < ) 2 mi J? + JDsin0, + D 2 /4 t (A3) 
r M =V(/sin^ -D/2) 2 +(/oos0 l ) s = Jf-lDsmOt +D 2 /4 . (A4) 



25 For a given delayed signal pair in the dual delay-line 342 of FIG. 9 to 

become equalized under this approach, the factors txi(m) and a/./+/ (m) must satisfy 
equation (A5) as follows: 

\Pi}o$(m)**p M \a imM (pO.. (AS) 
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15 



20 



Substituting equation (A2) info equation (A5), equation (A6) results as follows: 
n_ g,(m) (A6) 

By defining the value of <Xi(m) in accordance with equation (A7) as follows: 



where, is in units of inverse length and is chosen to provide a convenient 
amplitude level, the value of a w+ ; (m) is given by equation (A8) as follows: 



«/^i(m)= Kjl 2 +lDsine,_ i ^ +D 2 /4 = tf^/ z -ZDsin0 f +D 2 /4 9 (A8) 



where, the relation sin0/-,+/=-sin0, can be obtained by substituting I-i+l into i in 
equation (27). By substituting equations (A7) and (A8) into equation (A6), it may 
be verified that the values assigned to Qi(m) in equation (A7) satisfy the condition 
established by equation (A6). 

After obtaining the equalization factors Oi(m) in accordance with this 
embodiment, minor adjustments are preferably made to calibrate for asymmetries 
in the sensor arrangement and other departures from the ideal case such as those 
that might result from media absorption of acoustic energy, an acoustic source 
geometry other than a point source, and dependence of amplitude decline on 
parameters other than distance. 

After equalization by factors a, (m) with multipliers 346, the in-phase . 
desired signal component is generally the same in the left and right channels of the 
dual delay lines 342 for the delayed signal pairs corresponding to i = = s, and 
the in-phase noise signal component is generally the same in the left and right 
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channels of the dual delay lines 342 for the delayed signal pairs corresponding to j 
= /noise = g for the case of a single, predominant interfering noise source. The 
desired signal at i=s may be expressed as S n (m) = A s exp[/Y*<W + $ s )]; and the 
interfering signal at i=g may be expressed as G„(m) = A^expDXco^^^)], where 
and $ 8 denote initial phases. Based on these models, equalized signals 
afynyxj^m) for the left channel and a /4f i (m)X^(m) for the right channel at any 
arbitrary point i (except i = s) along dual delay lines 342 may be expressed in 
equations (29) and (30) as follows: 



04 (m> X 2? (m) A, exp j[a> m (t + r, - t t ) + tfj + a, expyl^Cr+r, -r f )+^] t 

. (29) 

a W4i (m)jrg(m) = 



15 where equations (31) and (32) further define certain terms of equations (29) and 
(30) as follows: 

x£w> = x^^cxpc-^ii) (31) 



20 \ 

• . ■ . \ 

Each signal pair a t {m}Xu (i) (m) and a N ^(myxJ i} (m) is input to a 
corresponding operation stage 354 of a corresponding one of operation arrays 352 
for all m; where each operator array 352 corresponds to a different value of m as in 
the case of dual delay lines 342. For a given operation array 352, operation stages 
25 354 corresponding to each value of /, except i=s, perform the operation defined by 
equation (33) as follows: 
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^<o (m) = g| (m) X% (m) - a^ x (m) X (m) 

(a, /a M )exp[ja> m CT, -r,)]-^, /a M )«p[yai.(T M -*/.,+.)] ' 

(33) 

for i * 

If the value of the denominator in equation (33) is too small, a small positive 
5 constant e is added to the denominator to limit the magnitude of the output signal 
X n (t) (rn). No operation is performed by the operation stage 354 on the signal pair 
corresponding to i=s for all m (all operation arrays 352 of signal operator 350). 

With the outputs from operation array 352, the simultaneous localization 
and identification of the spectral content of the desired signal may be performed 
10 with arrangement 310. Localization and extraction with arrangement 310 are 
further described by the signal flow diagram of FIG. 1 1 and the following 
mathematical model. By substituting equations (29) and (30) into equation (33), 
equation (34) results as follows: 

15 ^' > (m) = 5 il (m) + G Ji Cm)-t), ( ;(m) f i*s (3 4) 

where equation (35) further defines: 



(q, la t )exp[M,(T, -tjM-Ca,^, /« w )«p[j»«CWi 

20 



(35) 



By applying equation (26) to equation (35), equation (36) results as follows: 



25 



(f) (a, / a, ) exp[yfi> w (T, -t,)]- (g ; _^ / a,^ ) exp[- M, (t, - t, )] 
v«0»>- ( fl ^/ fl ^)exp[yffl S .(T f -T l )]-(o,^ l /o l ^ I )exp[-ya p (T,.-T l )] ' 



< 36 > 
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The energy of the signal X n (t) (jn) is expressed in equation (37) as follows: 



|^°(m)| 2 = \5 m (n* + G m (m) V^mf . (37 ) 



A signal vector may be defined: 
,(«) = /y(0/n v«> 



x««'«w<><i),*<'>(2) jrf><io.....x»a) n°(i^)) r . 



10 • i r 



where, T denotes transposition. The energy ||x ff; || f of the vector x w is given by 
equation (38) as follows: 

Mlm.1 <!<.( 1 (JO) 



Equation (38) is a double summation over time and frequency that approximates a 
double integration in a continuous time domain representation. 
Further defining the following vectors: 



20 



s = (5,(1).^, (2) S,{M ),5 2 (1) ^C*).....S„<1) W) r . and 

g (0 =(G,(lX(D.G 1 (2)<»(2) C7,(ilf)t><J(^),C? J (l)<'(l),...,G J (il/)v«(ilf), 

C w (D^(l) <?„( JOnS (M)) r . where i = 1 /. 



25 the energy of vectors s and gt i} are respectively defined by equations (39) and (40) 
as follows: 
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la-ZZfcC^f (39) 



N U 



W-ZZKw-nflwr. (40) 

5 

For a desired signal that is independent of the interfering source, the vectors 
s and gf° are orthogonal. In accordance with the Theorem of Pythagoras, equation 
(41) results as follows: 

10 frt-k+it-W+kt. (4i) 

Because || \ > 0, equation (42) results as follows: 

k"E*t»C. (42) 



The equality in equation (42) is satisfied only when \\gf° \\ I = 0, which happens if 
either of the following two conditions are met: (a) G„(m) = 0, i.e., the noise source 
is silent - in which case there is no need for doing localization of the noise source 
and noise cancellation; and (b) v s J t} (m) = 0; where equation (36) indicates that this 
second condition arises for i = g = w- Therefore, || x (i} || | has its minimum at i= 
g = tnoise, which according to equation (42) is \\s \\ I . Equation (43) further 
describes this condition as follows: 

K-ltMC-af+t- (43) 



Thus, the localization procedure includes finding the position r a oise along 
the operation array 352 for each of the delay lines 342 that produces the minimum 
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value of || x^H 2 . Once the location along the dual delay line 342 is 
determined, the azimuth position of the noise source may be determined with 
equation (27). The estimated noise location / 00i$e may be utilized for noise 
cancellation or extraction of the desired signal as further described hereinafter. 
5 Indeed, operation stages 354 for all m corresponding to i = i noisc provide the 
spectral components of the desired signal as given by equation (44): 

S m (/n) = X' J [ W (m) = S m (m) + G a (m) • (m) = S M (m) . 

(44) 

10 

Localization operator 360 embodies the localization technique of 
arrangement 310. FIG. 1 1 further depicts operator 360 with coupled pairs of 
summation operators 362 and 364 for each value of integer index i; where i=l t . . M L 
Collectively, summation operators 362 and 364 perform the operation 
15 corresponding to equation (38) to generate || x (i) j| \ for each value of L For each 
transform time frame n, the summation operators 362 each receive Xn (0 (l) through 
X n (0 (M) inputs from operation stages 354 corresponding to their value of i and 
sums over frequencies m=l through m=M. For the illustrated example, the upper 
summation operator 362 corresponds to i=l and receives signals X n (1) (l) through 
20 Xt {l) Q4) for summation; and the lower summation operator 362 corresponds to i=I 
and receives signals Xa (l) (l) through X„ (I) (M) for summation. 

Each summation operator 364 receives the results for each transform time 
frame n from the summation operator 362 corresponding to the same value of i 
and accumulates a sum of the results over time corresponding to n=l through n=N 
25 transform time frames; where N is a quantity of time frames empirically 

determined to be suitable for localization. For the illustrated example, the upper 
summation operator 364 corresponds to z=l and sums the results from the upper 
summation operator 362 over N samples; and the lower summation operator 364 
corresponds to i=l and sums the results from the lower summation operator 362 
30 over N samples. 
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The I number of values of \\xf i} \\ \ resulting from the I number of 
summation operators 364 are received by stage 366. Stage 366 compares the I 
number of || || I values to determine the value of i corresponding to the 
minimum (| xf° \\ I • This value of i is output by stage 366 as i = g = incise. 
5 Referring back to FIG. 8, post-localization processing by arrangement 3 10 

is further described. When equation (33) is applied to the pair inputs of delay lines 
342 at it corresponds to the position of the off-axis noise source and equation 
(20) shows it provides an approximation of the desired signal &„("*)- To extract 
signal £/,(/n), the index value i=g is sent by stage 366 of localization unit 360 to 

10 extraction operator 380. In response to g, extraction operator 380 routes the 

outputs Xn 0 ^!) through Xn^^ = £„(m) to Inverse Fourier Transform (EFT) stage 
382 operatively coupled thereto. For this purpose, extraction operator 380 
preferably includes a multiplexer or matrix switch that has LtM complex inputs 
and M complex outputs; where a different set of M inputs is routed to the outputs 

15 for each different value of the index / in response to the output from stage 366 of 
localization operator 360. 

Stage 382 converts the M spectral components received from extraction 
unit 380 to transform the spectral approximation of the desired signal, & n Qn), from 
the frequency domain to the time domain as represented by signal s n (k). Signal 

20 s„(Jfc) undergoes digital-to-analog conversion with subsystem 44 before 

transmission to acoustic I/O components 30a, 30b; or with components 30a, 30b 
after such transmission. Post extraction processing stage 480 processes the 
extracted output signal to provide separate acoustic output signals to each earphone 
24a, 24b. As previously described, these separate signals may be generally the 

25 same or different to account for the position of the desired source relative to 
sensors 22a, 22b. 

Another form of expression of equation (33) is given by equation (45) as 
follows: 

*i°(m) = w u Cm)X^(m) + v^(m)Xj£(m) . 
™ (45) 



31 



WO 01/87014 



PCT/USO 1/14945 



The terms and are equivalent to beamforming weights for the left and right 
channels, respectively. As a result, the operation of equation (33) may be 
equivalently modeled as a beamforming procedure that places a null at the location 
corresponding to the predominant noise source, while steering to the desired output 
5 signal s„(r). 

Referring to FIGs. 1 and 12-15, signal processing arrangement 410 for 
system 20 is described; where like reference numerals refer to like features. For 
arrangement 410, subsystem 44 is configured with appropriate hardware and/or 
software to include DFT stages 336a, 336b, delay operator 340, and signal operator 

10 350 as described for arrangement 310; and localization operator 460 which is the 
same as localization operator 360 of arrangement 310 except that equalization 
factors a,{m) (i=l t I) are set to unity for the localization processes associated 
with localization operator 460. Furthermore, localization operator 460 of 
arrangement 410 directly receives the output signals of delay operator 340 instead 

15 of the output signals of signal operator 350, unlike arrangement 310. 

The localization technique embodied in operator 460 begins by establishing 
two-dimensional (2-D) plots of coincidence loci in terms of frequency versus 
azimuth position. The coincidence points of each loci represent a minimum 
difference between the left and right channels for each frequency as indexed by m. 

20 This minimum difference may be expressed as the minimum magnitude difference 
5X n <0 (m) between the frequency domain representations X^im) and XiJ\m\ at 
each discrete frequency m, yielding M/2 potentially different loci. If the acoustic 
sources are spatially coherent, then these loci will be the same across all 
frequencies. This operation is described in equations (46)-(49) as follows: 

25 



i m (m) = argrain{5Y^>(m)} t m=l, .... M/2. (46) 



6X<° (m) = \X% (m) - X™ (m)| , f=l I\m=l M/2. (47) 
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(48) 

X%(m) = X u (m) exp(-/2/rr,m / M) , f=l, ...,/; m=l Af/2, 

X^^^X^^expC-^nr^m/Af). p=1, ...;/; m-1, ...,3f/2. (49) 



5 If the amplitudes of the left and right channels are generally the same at a 

given position along dual delay lines 342 of arrangement 410 as indexed by i\ then 
the values of SX n ( %n) for the corresponding value of i is minimized, if not 
essentially zero. It is noted that, despite inter-sensor intensity differences, 
equalization factors a t {m) (i=l, .... i) should be maintained close to unity for the 

10 purpose of coincidence detection; otherwise, the minimal 8Xn i} (m) will not 
correspond to the in-phase (coincidence) locations. 

An alternative approach may be based on identifying coincidence loci from 
the phase difference. For this phase difference approach, the minimum of the 
phase difference between the left and right channel signals at positions along the 

15 dual delay lines 342, as indexed by i, are located as described by the following 
equations (50) and (51): 



/n— 1 » Af/2 f 



(50) 



«<'>(m)=|lm[X^(m)X2 1 ) (m) t j, *>1, ...,/; m*l Af/2, (5 i) 



20 



where, Im[»] denotes the imaginary part of the argument, and the superscript t 
denotes a complex conjugate. Since the phase difference technique detects the 
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minimum angle between two complex vectors, there is also no need to compensate 
for the inter-sensor intensity difference. While either the magnitude or phase 
difference approach may be effective without further processing to localize a single 
source, multiple sources often emit spectrally overlapping signals that lead to 
5 coincidence loci which correspond to nonexistent or phantom sources (e.g., at the 
midpoint between two equal intensity sources at the same frequency). FIG. 14 
illustrates a 2-D coincidence plot 500 in terms of frequency in Hertz (Hz) along the 
vertical axis and azimuth position in degrees along the horizontal axis. Plot 500 
indicates two sources corresponding to the generally vertically aligned locus 512a 
10 at about -20 degrees and the vertically aligned locus 512b at about + 40 degrees. 
Plot 500 also includes misidentified or phantom source points 514a, 514b, 514c, 
514d, 514e at other azimuths positions that correspond to frequencies where both 
sources have significant energy. Plots having more than two differently located 
competing acoustic sources generally result in an even more complex plot. 

15 To reduce the occurrence of phantom information in the 2-D coincidence 

plot data, localization operator 460 integrates over time and frequency. When the 
signals are not correlated at each frequency, the mutual interference between the 
signals can be gradually attenuated by the temporal integration. This approach 
averages the locations of the coincidences, not the value of the function used to 

20 determine the minima, which is equivalent to applying a Kronecker delta function, 
8(/-i„(m)) to 5X/' j (m) and averaging the 8(i-i n (m)) overtime. In turn, the 
coincidence loci corresponding to the true position of the sources are enhanced. 
Integration over time applies a forgetting average to the 2-D coincidence plots 
acquired over a predetermined set of transform time frames from n =1, ., N; and is 

25 expressed by the summation approximation of equation (52) as follows: 

M$.^ = X0*""$0-*.Cm>>, p=1 /;m=l M/2, (52) 



where, 0 <p<l is a weighting coefficient which exponentially de-emphasizes (or 
forgets) the effect of previous coincidence results, S(») is the Kronecker delta 

34 



WO 01/87014 PCT/US01/14945 



function, 8/ represents the position along the dual delay-lines 342 corresponding to 
spatial azimuth 8, [equation (26)], and AT refers to the current time frame. To 
reduce the cluttering effect due to instantaneous interactions of the acoustic 
sources, the results of equation (52) are tested in accordance with the relationship 
defined by equation (53) as follows: 



20 



P„($.m)>r (53) 
otherwise. 



where T > 0, is an empirically determined threshold. While this approach assumes 
the inter-sensor delays are independent of frequency, it has been found that 

10 departures from this assumption may generally be considered negligible. By 
integrating the coincidence plots across frequency, a more robust and reliable 
indication of the locations of sources in space is obtained. Integration of P„(8i,m) 
over frequency produces a localization pattern which is a function of azimuth. 
Two techniques to estimate the true position of the acoustic sources may be 

15 utilized. The first estimation technique is solely based on the straight vertical 

traces across frequency that correspond to different azimuths. For this technique, 
Q d denotes the azimuth with which the integration is associated, such that &d 83 8/. 
and results in the summation over frequency of equation (54) as follows: 



where, equation (54) approximates integration over time. 

The peaks in H n (Q d ) represent the source azimuth positions. If there are Q 
sources, Q peaks in H^Qd) may generally be expected. When compared with the 
patterns 8(i-i /I (/w)) at each frequency, not only is the accuracy of localization 
25 enhanced when more than one sound source is present, but also almost immediate 
localization of multiple sources for the current frame is possible. Furthermore, 
although a dominant source usually has a higher peak in H#(Qd) than do weaker 
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sources, the height of a peak in H#(Qd) only indirectly reflects the energy of the 
sound source. Rather, the height is influenced by several factors such as the 
energy of the signal component corresponding to Q d relative to the energy of the 
other signal components for each frequency band, the number of frequency bands, 
5 and the duration over which the signal is dominant In fact, each frequency is 
weighted equally in equation (52). As a result, masking of weaker sources by a 
dominant source is reduced. In contrast, existing time-domain cross-correlation 
methods incorporate the signal intensity, more heavily biasing sensitivity to the 
dominant source. 

10 Notably, the interaural time difference is ambiguous for high frequency 

sounds where the acoustic wavelengths are less than the separation distance D 
between sensors 22a, 22b. This ambiguity arises from the occurrence of phase 
multiples above this inter-sensor distance related frequency, such that a particular 
phase difference A$ cannot be distinguished from A<j> +2rc. As a result, there is not 

15 a one-to-one relationship of position versus frequency above a certain frequency. 
Thus, in addition to the primary vertical trace corresponding to 6</ = 8/, , there are 
also secondary relationships that characterize the variation of position with 
frequency for each ambiguous phase multiple. These secondary relationships are 
taken into account for the second estimation technique for integrating over 

20 frequency. Equation (55) provides a means to determine a predictive coincidence 
pattern for a given azimuth that accounts for these secondary relationships as 
follows: \ 



sin0,-sin6L = — ^ , (55) 

d ITD / 

where the parameter y^d is an integer, and each value of y^d defines a contour in 
25 the pattern P/v(8^m). The primary relationship is associated with y^d =0. For a 
specific Qd. the range of valid y^d is given by equation (56) as follows: 
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The graph 600 of FIG. 15 illustrates a number of representative coincidence 
patterns 612, 614, 616, 618 determined in accordance with equations (55) and (56); 
where the vertical axis represents frequency in Hz and the horizontal axis 
represents azimuth position in degrees. Pattern 612 corresponds to the azimuth 
5 position of 0°. Pattern 612 has a primary relationship corresponding to the 

generally straight, solid vertical line 612a and a number of secondary relationships 
corresponding to curved solid line segments 612b. Similarly, patterns 614, 616, 
618 correspond to azimuth positions of -75°, 20°, and 75° and have primary 
relationships shown as straight vertical lines 614a, 616a, 618a and secondary 

10 relationships shown as curved line segments 614b, 616b, 618b, in correspondingly 
different broken line formats. In general, the vertical lines are designated primary 
contours and the curved line segments are designated secondary contours. 
Coincidence patterns for other azimuth positions may be determined with 
equations (55) and (56) as would occur to those skilled in the art. 

15 Notably, the existence of these ambiguities in Pjtffii/ri) may generate 

artif actual peaks in H/^QJ) after integration along 0* = 6/. Superposition of the 
curved traces corresponding to several sources may induce a noisier HfrfQd) term. 
When far away from the peaks of any real sources, the artifact peaks may 
erroneously indicate the detection of nonexistent sources; however, when close to 

20 the peaks corresponding to true sources, they may affect both the detection and 
localization of peaks of real sources in H^dd)- When it is desired to reduce the 
adverse impact of phase ambiguity, localization may take into account the 
secondary relationships in addition to the primary relationship for each given 
azimuth position. Thus, a coincidence pattern for each azimuthal direction Q d (d=l, 

25 . . I) of interest may be determined and plotted that may be utilized as a "stencil" 
window having a shape defined by Pn(0/ m) (r=l ,...,/; m=l , . . . , M). In other 
words, each stencil is a predictive pattern of the coincidence points attributable to 
an acoustic source at the azimuth position of the primary contour, including 
phantom loci corresponding to other azimuth positions as a factor of frequency. 

30 The stencil pattern may be used to filter the data at different values of m. 

By employing the equation (56), the integration approximation of equation 
(54) is modified as reflected in the following equation (57): 
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YmJ - + sinflAm]. rf==l /. (57) 



where i4(6rf) denotes the number of points involved in the summation. Notably, 
equation (54) is a special case of equation (57) corresponding to y^d =0. Thus, 
5 equation (57) is used in place of equation (54) when the second technique of 

integration over frequency is desired. As shown in equation (26), both variables 8* 
and tf are equivalent and represent the position in the dual delay-line. The 
difference between these variables is that 9/ indicates location along the dual 
delay-line by using its corresponding spatial azimuth, whereas t,- denotes location 
10 by using the corresponding time-delay unit of value x,- . Therefore, the stencil 

pattern becomes much simpler if the stencil filter function is expressed with t, as 
defined in the following equation (58): 

*<- T '=2/^ (58) 



15 where, prelates to Q d through equation (28). For a specific x d , the range of valid 
y^rfis given by equation (59) as follows: 

\ 

-(rro^/2+T rf )/ M ^y^^(Tro oM /2-T lf )/., y m4 isaninteger. (59) 



Changing value of \ d only shifts the coincidence pattern (or stencil pattern) along 
20 the T/-axis without changing its shape. The approach characterized by equations 

(58) and (59) may be utilized as an alternative to separate patterns for each azimuth 
position of interest; however, because the scaling of the delay units x,- is uniform 
along the dual delay-line, azimuthal partitioning by the dual delay-line, is not 
uniform, with the regions close to the median plane having higher azimuthal 
25 resolution. On the other hand, in order to obtain an equivalent resolution in 



38 



WO 01/87014 



PCT/US01/14945 



azimuth, using a uniform t/ would require a much larger / of delay units than using 
a uniform 9 X . 

The signal flow diagram of FIG. 13 further illustrates selected details 
concerning localization operator 460. With equalization factors <x,(m) set to unity, 
5 the delayed signal of pairs of delay stages 344 are sent to coincidence detection 

operators 462 for each frequency indexed to m to determine the coincidence points. 
Detection operators 462 determine the minima in accordance with equation (46) or 
(50). Each coincidence detection operator 462 sends the results i„(wi) to a 
corresponding pattern generator 464 for the given m. Generators 464 build a 2-D 

10 coincidence plot for each frequency indexed to m and pass the results to a 
corresponding summation operator 466 to perform the operation expressed in 
equation (52) for that given frequency. Summation operators 466 approximate 
integration over time. In FIG. 13, only operators 462, 464, and 466 corresponding 
to m =1 and m =M are illustrated to preserve clarity, with those corresponding to m 

15 =2 through m = M-l being represented by ellipses. 

Summation operators 466 pass results to summation operator 468 to 
approximate integration over frequency. Operators 468 may be configured in 
accordance with equation (54) if artifacts resulting from the secondary 
relationships at high frequencies are not present or may be ignored. Alternatively, 

20 stencil filtering with predictive coincidence patterns that include the secondary 
relationships may be performed by applying equation (57) with summation 
operator 468. 

Referring back to FIG. 12, operator 468 outputs H N (0d) to map data block 
490, which corresponds to acoustic source positional information. With the map 
25 data of block 490, acoustic sources can be localized and tracked dynamically as 
they move in space. Movement trajectories may be estimated from the sets of 
locations 8(z-f„(m)) computed at each sample window n. 

The localization techniques of localization operator 460 are particularly 
suited to localize more than two acoustic sources of comparable sound pressure 
30 levels and frequency ranges, and need not specify an on-axis desired source. As 
such, the localization techniques of arrangement 410 provide independent 
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capabilities to localize and map more than two acoustic sources relative to a 
number of positions as defined with respect to sensors 22a, 22b. However, in other 
embodiments, the localization capability of localization operator 460 may also be 
utilized in conjunction with a designated reference source to perform extraction 
5 and noise suppression. Indeed, extraction operator 480 of the illustrated 
embodiment incorporates such features as more fully described hereinafter. 

It has been discovered that by suppressing one or more different frequency 
components in each of a plurality of interfering sources after localization, it is 
possible to reduce the interference from the noise sources in complex acoustic 
10 environments, such as in the case of multi-talkers, in spite of the temporal and 

frequency overlaps between talkers. Although a given frequency component or set 
of components may only be suppressed in one of the interfering sources for a given 
time frame, the dynamic allocation of suppression of each of the frequencies 
among the localized interfering acoustic sources generally results in better 
15 intelligibility of the desired signal than is possible by simply nulling only the most 
offensive source at all frequencies. 

Extraction operator 480 provides one implementation of this approach by 
utilizing localization information from localization operator 460 to identify Q 
interfering noise sources corresponding to positions other than i = s. The positions 
20 of the Q noise sources are represented by i=noisel , noise! , ; . . , noiseQ. Notably, 
operator 480 receives the outputs of signal operator 350 as described in connection 
with arrangement 310, that presents corresponding signals x n ( ^ ndiscl) (m), x n (i=noise2) 
(m), .... x n (t=not * eQ) (m) for each frequency m. These signals include a component of 
the desired signal at frequency m as well as components from sources other than 
25 the one to be canceled. For the purpose of extraction and suppression, the 

equalization factors afyn) need not be set to unity once localization has taken place. 
To determine which frequency component or set of components to suppress in a 
particular noise source, the amplitudes of Xn <itsnoisttl) (;n), x n r/=noise2 ' (/n), . . . , 
x 0=noiseQ) (;n) ^ ca i culated md compared. The minimum X n (UtoUe) (m), is taken as 
30 output S„(m) as defined by the following equation (60): 

Um) = X n (i,toise >(m) f (60) 
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where, X n (inoise} (pi) satisfies the condition expressed by equation (61) as follows: 

| Xj"** (m) | = min{ | X n (iM) (m) | , | Xj^** 2 > (m) | | (m) \ , 

\a s (m)Xj s) (m)\y 9 (61) 

for each value of m. It should be noted that, in equation (61), the original signal 
5 a.s(m) XLn (s) (m) is included The resulting beam pattern may at times amplify other 
less intense noise sources. When the amount of noise amplification is larger than 
the amount of cancellation of the most intense noise source, further conditions may 
be included in operator 480 to prevent changing the input signal for that frequency 
at that moment 

10 Many other embodiments of the present invention are envisioned. For 

example, any of airangements 110, 310, 410 can be utilized for processing 
performed with system 20a or 20b. In another example, the signal processor 42 
and memory 50 of arrangement 1 10 is utilized in part or in whole to implement 
features of processing arrangements 310 or 410. 

15 Another embodiment includes operating a hearing aid including a first 

component and a second component, where the first component includes a pair of 
conductors. The first and second components are placed in contact with skin in a 
spaced apart relationship. The first pair of conductors are each electrically coupled 
to the skin through this placement. An electric potential is generated between the 

20 conductors to transmit an electrical communication signal from the first component 
to the skin in contact therewith. This signal is received by the second component 
over an electrical transmission pathway along the skin between the two 
components. 

Yet another embodiment includes: operating a hearing aid including a first 
25 component and a second component, where the first component includes a first 
pair of electrodes and the second component includes a second pair of electrodes; 
electrically engaging the first pair of electrodes and the second pair of electrodes 
with skin; and transmitting an electrical signal from the first component to the 
second component by electrical conduction along the skin between the first pair of 
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electrodes and the second pair of electrodes during this engagement 

In still another embodiment, a hearing aid is provided that includes first and 
second components, where the first component includes an acoustic sensor. The 
first and second components contact skin, and an electrical signal is transmitted 
5 from the first component to the second component during this contact by electrical 
conduction along a pathway formed by the skin between the first and second 
components. 

A further embodiment includes a system comprising a hearing aid to 
enhance hearing of a user. This hearing aid includes a first component for 

10 placement in contact with the skin of the user. The first component includes a first 
pair of electrodes to electrically couple to the skin and a transmission circuit 
operable to transmit electrical signals to the skin through the first pair of 
electrodes. A second component is also included in the hearing aid that is spaced 
apart from the first component. This second component is sized for placement in a 

15 passageway of an ear of the user. The second component includes a receiver 

circuit. This receiver circuit receives the electrical signals by electrical conduction 
along the skin from the first component. The second component also includes an 
output device responsive to the electrical signals to stimulate hearing of the user. 
Yet a further embodiment includes: detecting acoustic excitation with a 

20 number of acoustic sensors that provide a number of sensor signals; establishing a 

set of frequency components for each of the sensor signals; and determining an 

\ . . . 

output signal representative of the acoustic excitation from a designated direction. 
. This determination includes weighting the set of frequency components for each of 
the sensor signals to reduce variance of the output signal and provide a predefined 

25 gain of the acoustic excitation from the designated direction. 

In another embodiment, a hearing aid includes a number of acoustic sensors 
in the presence of multiple acoustic sources that provide a corresponding number 
of sensor signals. A selected one of the acoustic sources is monitored An output 
signal representative of the selected one of the acoustic sources is generated. This 

30 output signal is a weighted combination of the sensor signals that is calculated to 
minimize variance of the output signal. 
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Another embodiment includes: operating a voice input device including a 
number of acoustic sensors that provide a corresponding number of sensor signals; 
determining a set of frequency components for each of the sensor signals; and 
generating an output signal representative of acoustic excitation from a designated 
5 direction. This output signal is a weighted combination of the set of frequency 
components for each of the sensor signals calculated to minimize variance of the 
output signal. 

Still a further embodiment includes an acoustic sensor array operable to 
detect acoustic excitation that includes two or more acoustic sensors each operable 

10 to provide a respective one of a number of sensor signals. Also included is a 
processor to determine a set of frequency components for each of the sensor 
signals and generate an output signal representative of the acoustic excitation from 
a designated direction. This output signal is calculated from a weighted 
combination of the set of frequency components for each of the sensor signals to 

15 reduce variance of the output signal subject to a gain constraint for the acoustic 
excitation from the designated direction. 

In another embodiment, a signal processing system localizes and extracts acoustic 
excitation from a selected one of a number of acoustic sources. The system includes two 
spaced apart sensors to detect the sources and a processing subsystem with a delay line. 

20 The system can be provided in the form of two or more modules that communicate: with 
each other using skin as a transmission medium. Alternatively or additionally, this 
embodiment may include filtering based on coincidence loci. 

A further embodiment includes a processing system comprised of two or more 
modules that use skin as a communication medium. For this embodiment, a first signal 

25 is provided from a first acoustic sensor and a second signal from a second acoustic 
sensor spaced apart from the first acoustic sensor. The first and second signals each 
correspond to a composite of two or more acoustic sources that, in turn, include a 
plurality of interfering sources and a desired source. The interfering sources are 
localized by processing of the first and second signals to provide a corresponding 

30 number of interfering source signals. These signals each include a number of frequency 
components. One or more of the frequency components are suppressed for each of the 
interfering source signals. 
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EXPERIMENTAL SECTION 

The present invention will be further described with reference to the 
following specific examples. These experiments and results are intended to be 
illustrative of the present invention and should not be considered limiting or 
5 restrictive with regard to the scope of the present invention. 

Experiments have been conducted using both analog FM signals and FSK 
digital communication techniques. In the analog FM test, a transmitter included a 
DSP56002 board from Motorola with a digital signal processor (DSP). The 
transmitter also included a direct digital synthesizer (DDS) modulator (AD7008) 

10 coupled to the board The DDS provided a carrier frequency modulation (range: 
1Hz to 25MHz) with a signal of frequency < 18kHz. The system was tested in the 
range of 50 kHz to 5 MHz. Signal-to-noise ratio (SNR) measurements relative to 
the noise floor indicated that preferred frequency ranges (60dB) were 1.0-2.0 and 
3.5-5.0 MHz, with a dip to 50 dB iri the 2.0-3.5 MHz range. Low impedance HP 

15 40493D foam Ag/AgCl electrodes with an area of 0.4 of a square inch were used to 
provide electrode pairs for most FM tests. The measurements above were taken at 
a transmit/receive separation of 7 cm. The signal was attenuated by 2-3 dB for 
each additional 20 cm of transmission length across the skin. No difference was 
noted between trials on one person in which the electrodes were placed on the 

20 same arm relative to the case where the pairs were placed behind the two ears. 
Tests were also performed with custom electrodes (Easy-How 45 welding strips; 
Ag/Cu/Zn/Cd; 1.3 square inches ) for which there was a loss of 3 dB; however 
signals could still be suitably sent from one ear to the other. 

FSK testing used the DSP56002 board and the DDS for a transmitter, 

25 which was adjusted to provide modulated transmission signals in an FSK format 
The DDS mapped the symbols to be transmitted into deviation frequencies off the 
center frequency. A center frequency of 5 MHz was used with deviation 
frequencies of 10, 13, 16, and 19 kHz. The transmitted signal was then sent to a 
receiver via skin transmission. The receiver comprised an RF/IF mixer coupled to 

30 a waveform generator. The waveform generator provided a 5 MHz signal that was 
used to demodulate the received signal, bringing it down to the kilohertz range. 
The mixer was coupled to a DSP56302 processing board, which detected the 
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mixed signals. A sampling rate of 48kHz was used and 32 samples per symbol 
were acquired. Both cosine and sine wave matched filters, one pair of each target 
frequency (e.g., 10, 13, 16 and 19 kHz), were applied to the samples and the 
outputs were squared and summed to derive measures of signal strength at each 
5 frequency. The largest value was assumed to correspond to the frequency - and 
hence the code - which had been transmitted. 

For the FSK testing, two pairs of electrodes (HP 40493D; connected to the 
transmitter and the receiver, respectively) were placed upon different body parts 
(e.g., hands, neck and ear). Testing showed that the receiver still correctly 

10 identified symbols over a long transmission distance, e.g., from the hand to ear 
lobe. Testing was also performed to detect possible bit errors that may emanate 
from transmission through the skin. A 128 length input stream of O's and Vs was 
sent over a direct connection and across the skin from the wrist to the ear lobe. 
There were no bit errors in this test. The results of these tests show that 

IS transmission of signals across the skin is feasible and reliable* 

During the experiments, the current measured across the skin was in the 
range of 3-4 jiA. This is well below the "Safe Current Limits for Electrical 
Apparatus" set by the American National Standards Institute (ANSI), i.e., 1 mA 
(rms) for frequencies of >1 MHz, and 1-2 order below the range that can pose 

20 danger for heart defibrillation. Furthermore, experiments have been conducted 
using a dielectric between the electrode pairs and skin; where the electrical 
coupling is capaciti ve. This indirect coupling technique has been found acceptable 
for transmission frequencies in the range of 100 MHz to 1.5 GHz. 

All publications, patents, and patent applications cited in this specification 

25 are herein incorporated by reference as if each individual publication, patent, or 
patent application were specifically and individually indicated to be incorporated 
by reference and set forth in its entirety herein. Further, any theory, mechanism of 
operation, proof, or finding stated herein is meant to further enhance understanding 
of the present invention and is not intended to make the present invention in any 

30 way dependent upon such theory, mechanism of operation, proof, or finding. 

While the invention has been illustrated and described in detail in the drawings and 
foregoing description, the same is to be considered as illustrative and not restrictive 
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in character, it being understood that only selected embodiments have been shown 
and described and that all changes, modifications and equivalents that come within 
the spirit of the invention as defined by the following claims are desired to be 
protected 



\ 
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What is claimed is: 

1 . A method, comprising: 

operating a hearing aid including a first component and a second 
5 component, the first component including a first pair of conductors; 

placing the first component and the second component in contact with a 
skin surface in a spaced apart relationship, the first pair of conductors each being 
electrically coupled to the skin surface by said placing; 

generating an electric potential between the first pair of conductors to 
10 transmit a first electrical communication signal from the first component to the 
skin in contact with the first component; and 

receiving the first electrical communication signal with the second 
component over an electrical transmission pathway along the skin between the first 
component and second component 

15 

2. The method of claim 1, wherein the first pair of conductors are each 
capacitively coupled to the skin surface by a dielectric positioned therebetween. 

3. The method of claim 1 , further comprising disposing the second component 
20 in a passage of an ear of a user of the hearing aid and positioning the first 

component outside the ear. 

\ 

\ 

4. The method of claim 3, wherein the second component is a cochlear 
implant. 

25 

5. The method of claim 3, wherein the first component includes a sensor to 
detect an acoustic excitation and one or more of the first component and the second 
component includes a signal processor. 

30 6. The method of claim 4, wherein the second component includes a plurality 

of conductors electrically coupled to the skin of the user to receive the electric 

communication signal and further comprising transmitting a second electrical 
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communication signal from the second component to the first component by 
electrical conduction through the portion of the skin between the first component 
and the second component 

5 7. The method of claim 1, wherein the electric communication signal is a 
modulated, time varying waveform. 

8. A method, comprising: 

operating a hearing aid including a first component and a second 
10 component, the first component including a first pair of electrodes and the second 
component including a second pair of electrodes; 

electrically engaging the first pair of electrodes and the second pair of 
electrodes with skin; and 

transmitting an electrical signal from the first component to the second 
15 component by electrical conduction along the skin between the first pair of 
electrodes and the second pair of electrodes during said engaging. 

9. The method of claim 8, wherein said electrically engaging is performed by 
capacitively coupling the first pair of electrodes to the skin with a dielectric 

20 positioned therebetween. 

10. The method of claim 8, wherein the first pair of electrodes and the second 
pair of electrodes establish an electrical conduction circuit including the skin. 

25 11. The method of claim 8, wherein the hearing aid further includes a third 
component having a third pair of electrodes electrically engaged with the skin to 
communicate with at least one of the first component and the second component by 
electric conduction through the skin positioned therebetween, the third component 
including an acoustic sensor. 

30 

12. The method of claim 11, wherein the first component includes a signal 
processor and the second component includes an output device to stimulate hearing 
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of a user of the hearing aid, and further comprising: 

positioning the second component in a passageway of ah ear of the user; 

receiving an input signal from the third component corresponding to an 
acoustic excitation; 

5 processing the input signal with the signal processor to generate the 

electrical signal; and 

providing an output signal to the ear of the user with the output device. 

13. A method, comprising: 

10 providing a hearing aid including a first component and a second 

component, the first component including an acoustic sensor; 

contacting skin with the first component and the second component; and 
transmitting an electrical signal from the first component to the second 
component during said contacting by electrical conduction along a pathway formed 
15 by the skin between the first component and second component. 

14. The method of claim 13, wherein the hearing aid comprises a third 
component including another acoustic sensor, the third component is spaced apart 
from the first component and the second component and is in communication with 

20 the second component by electrical conduction along the skin between the third 
component and the second component, and the first component and the third 

component are operable to provide a binaural input to the second component 

\ 

15. The method of claim 14, wherein the second component includes a signal 
25 processor to process the binaural input. 

16. The method of claim 15, wherein the hearing aid further includes a fourth 
component positioned in a passage of an ear of a user of the hearing aid, the fourth 
component being in communication with the second component to provide an 

30 output signal to stimulate hearing perception of the user. 
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17. Hie method of claim 16, wherein the fourth component is a cochlear 
implant. 

5 18. A system comprising: a hearing aid to enhance hearing of a user, the 
hearing aid including: 

a first component operable for placement in contact with skin of the user, 
the first component including a first pair of electrodes operable to be electrically 
coupled to the skin and a transmitter circuit operable to transmit electrical signals 
10 to the skin through said first pair of electrodes; and 

a second component spaced apart from said first component, said second 
component being sized for placement in a passageway of an ear of the user, the 
second component including a receiver circuit to receive said electrical signals by 
electric conduction along the skin from said first component and an output device 
15 responsive to said electrical signals to stimulate hearing of the user. 

19. Hie system of claim 18, wherein the second component includes a second 
pair of electrodes operable to electrically couple with the skin of the user to receive 
said electric signals. 

20 

20. The system of claim 18, wherein the second component is in the form of a 
cochlear implant. \ 

21. The system of claim 1 8, wherein the first component includes an acoustic 
25 sensor. 

22. The system of claim 18, wherein at least one of the first component and the 
second component includes a signal processor. 

30 23. The system of claim 18, further comprising means for receiving an acoustic 
input 
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24. Hie system of claim 23, further comprising means for processing the 
acoustic input. 

25. The system of claim 24, wherein said receiving means includes at least two 
5 acoustic sensors configured to be spaced apart from one another. 

26. The system of claim 24, wherein said first component includes a dielectric 
layer at least partially covering said first pair of electrodes. 

10 



51 



WO 01/87014 



PCT/US01/14945 




t « 




WO 01/87014 



PCT/US01/14945 



5/15 

20b 




Fig. 5 



■ • • 



WO 01/87014 



PCT/US01/14945 



7/15 



260 



Shift Buffer 



270- 



C START ) 



Begin A/D Sampling ond Storage 



,240 
•242 




v NO / \ 

Continue Routine HALT j 



YES 



•244 



Perform FFT ond Input to Buffer 



246 



Get previously Stored FFT from Buffer 



248 



258 



Apply Current Weights W(k) 



250 



Perform IFFT 



•252 



Perform D/A Conversion 



NO 



254 



< fime for New W(k) ColculationT > 
YESl ' — 256 



Calculate Correlation Matrix 



Determine New Weights W(k) 



262 



264 



Fig.7 



WO 01/87014 



PCT/US01/14945 



8/15 



o 

s s, 

— ^ 
o 
o 
o 



CO 



C7> 



z. 



J> LO 



II 

£ 



04 



^ SI 



II 

E 



\ 



CM 



Q 
Q 



ion 










1 — e^l 


o S3 






LU 








F 









c ^ s 

-CO 

c 
-00 



Q 
Q 



si 



il 

E 




o 

o c 

lu a 
o 

o 
cu 



or 
X 



o 

CX3 

















c 








I 


X 


L X 


X 



CNl 



csi • 



CO 




00 



WO 01/87014 



PCT/US01/14945 



9/15 




CJ> 



WO 01/87014 PCT/US01/14945 



10/15 




Fig. 10 



WO 01/87014 



11/15 



PCT/US01/14945 




WO 01/87014 



PCT/USOI/14945 



12/15 




WO 01/87014 



PCT/US01/14945 



13/15 




WO 01/87014 



PCT/US01/14945 



14/15 





WO 01/87014 



PCT/US01/14945 



15/15 




